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(1) Real Party In Interest 

The real party in interest is Hewlett-Packard Development Company, L.P.» the named 
assignee in this application. 

(2) Related Appeals And Interferences 

"There are no other appeals or interferences related to this case. 

(3) Status Of Claims 

Claims 5, 6, 13, 15, 17, 19, 22-24, and 26 have been canceled without prejudice or 
disclaimer of the subject matter contained therein* 

Claims 1-4, 6, 8-12, 14J 5 t 1 8, 20, 21, 25 T and 27-33 arc pending and stand rejected. 

Pursuant to 37 CF.R- § 41.37, the Appellants hereby appeal the Examiner's decision 
finally rejecting Claims 1 -4, 6, 8-12, 1 4, 1 5, 1 8, 20 s 2 1 , 25, and 27-33 to the Board of Patent 
Appeals and Interferences. Therefore, Claims 1-4, 6, 8-12, 14, 15, 1 8, 20, 21 , 25, and 27-33 
of this application arc at issue on this appeal, 

(4) Status of Amendments 

No amendment was filed subsequent to the final Office Action dated September 1 9, 

2006. 

A copy of the claims at issue on appeal is attached as the Claims Appendix. 
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(5) Summary Of Claimed Subject Mutter 

Claims 1, 3, 15, and 21 of the present invention arc the independent claims at issue in 
this appeal. 

Claim 1 pertains to an image enhancement method using face detection algorithms 
(Figure 3), In the method* one or more human faces in an image are automatically detected 
and located using fecc detection algorithms. Specification, page 7, lines 27 and 28, 
describing step 320. In addition, the appearance of the entire image is automatically 
enhanced by using a mapping technique to produce the image with target levels for a mean 
value or a variation value of the pixels in the one or more human faces, wherein the entire 
image is automatically enhanced such that the pixels in the one or more human faces have the 
target levels for the mean value or the variation value of the pixels. Specification* page 7» 
line 29 to page 8, line S, describing step 340. 

Claim S pertains to an apparatus for enhancing an image using face detection 
algorithms (Figure 1), The apparatus includes a module for automatically detecting human 
feces in an image using face detection algorithms. The apparatus also includes a module for 
automatically locating one or more human faces in the image, and a module for automatically 
enhancing an appearance of the entire image by using a mapping technique to produce the 
image with target levels for a mean value or a variation value of the pixels in the one or more 
human faces, wherein the entire image is automatically enhanced such that the pixels in the 
one or more human feces have the target levels for the mean value or the variation value of 
the pixels. Specification, page 7, line 25 to page S, line S. As discussed on page 7, lines 25 
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and 26, the claimed modules may comprise software modules for execution by a processor 
114. 

Claim 1 5 pertains to a computer readable medium comprising instructions for image 
enhancement using face detection- The computer readable medium instructions include 
automatically detecting one or more human faces in an image using face detection 
algorithms, automatically locating the one or more human feces in the image, and 
automatically enhancing an appearance of the entire image by using a mapping technique to 
produce the image with target levels for a mean value or a variation value of the pixels in the 
one or more human faces, wherein the target levels are desirable lightness and contrast levels 
as determined through a determination of human visual preferences, wherein the entire image 
is automatically enhanced such that the pixels in the one or more human fttces have the target 
levels for the mean value or the variation value of the pixels. Specification? page 7, line 25 to 
page S, line S. As discussed on page 7, lines 25 and 26, the claimed modules may comprise 
software modules for execution by a processor 1 14. 

Claim 21 pertains to a system for enhancing an image using face detection algorithms. 
The system includes means for automatically detecting human faces in an image using ftce 
detection algorithms, means for automatically locating the human faces in the image, and 
means for automatically enhancing an appearance of the entire image by using a mapping 
technique to produce the image with target levels for a mean value or a variation value of the 
pixels in the human faces, wherein the target levels are desirable lightness and contrast levels 
as determined through a determination of human visual preferences, wherein the entire image 
is automatically enhanced such that the pixels in the one or more human faces have the target 
levels for the mean value or the variation value of the pixels. Specification, page 7, line 25 to 

PAGE 8/32 ' RCVD AT 2/1912007 2:01:51 PM [Eastern Standard Time] ' SVR:USPTO-EFXRF-3/21 * DNIS:2738300 * CSID:703 865 5150 * DURATION (mm-ss):08-24 



FEB-1 9-EO07(M0N) Id: 39 NRNNRUR & KRNG, P. C. 



(FRX)703 865 5150 



P. 009/03E 



PATENT Atty Docket No-: 10006299-1 

App, Sex. Mo.: 09/854,580 

page 8, line 8. According to an example, the various means claimed in Claim 21 may 
comprise the software modules discussed on page 7, lines 25 and 26, which may be executed 
by a processor 1 14. In addition, or alternatively, the variously claimed means may comprise 
the processor 1 14 and either or both of the memories 1 02 and 1 1 2. 

(6) Grounds of Rejection to be Reviewed on Appeal 

a) Whether Claims 1 , 2, 8, 1 0 3 15, 21, and 27-33 should have been rejected under 35 
U.S.C. 1 03(a) as being unpatentable over U.S. Patent No. 6,292,574 to Schildkmut et al. 
(hereinafter "Schildkraut ct al.) in view of U.S. Patent No. 6,181,806 to Kado ct al. 
(hereinafter "Kado et al ") and lurthcr in view of U.S. Patent No. 5,41 0,618 to Fowler 
(hereinafter "Fowler**)* 

b) Whether Claims 3, 4, 1 1. 1 2, and 1 8 should have been rejected under 35 U.S.C. 
103(a) as being unpatentable over Schildkraut ct al* in view of Kado ct al. and Fowler, and 
further in view of U.S. Patent No. 6,680,745 to Center, Jr. ct ah (hereinafter "Center, Jr. ct 
aL"). 

c) Whether Claims 6, 14, 20, and 25 should have been rejected under 35 U-S-C. 

1 03(a) as being unpatentable over Schildkraut et al. in view of Kado et al. and Fowler, and 
further in view of U.S. Patent No. 6,009,209 to Acker et al. (hereinafter "Acker ct ah"). 
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(7) Arguments 

A. The_Examiner*s_ Position 

With reference to the Final Official Action dated September 19, 2006 (hereinafter 
iC Final Official Action"), the Examiner is of the opinion that the proposed combination of 
Schildkraut ct al., Kado et al„ and Fowler discloses all of the features claimed in Claims 1 , 2, 
S, 10, 15, 21, and 27-33 and that these claims are therefore unpatentable. 

In setting forth this rejection, the Examiner asserts that Schildkraut ct aL discloses 
"automatically detecting one or more human faces in an image using face detection 
algorithms and automatically locating the one or more human feces in the image " The 
Examiner cites to Figure 2, reference numeral SI 0; Figure 6; and column 4, line 13 to column 
5, line 4 as disclosing these features. {Final Official Action^ page 5, par. 7). 

With further reference to Schildkmut et al., the Examiner correctly notes that 
Schildkraut et al. fails to disclose that an appearance of an entire image is automatically 
enhanced u by using a mapping technique to produce the image with target levels for a mean 
value or a variation value of the pixels in the one or more human faces, wherein the entire 
image is automatically enhanced such thai the pixels in the one or more human faces have 
the target levels for the mean value or the variation value of the pixels" Emphasis in 
original. (Final Official Action^ page 5, par. 7), 

In an effort to make up for this deficiency in Schildkraut et ah, the Examiner attempts 
to rely upon the disclosures contained in Kado et al. and Fowler. More particularly, the 
Examiner cites to Figure 14, reference numeral 16 and column 7, lines 33-36 of Kado et al. as 
disclosing automatic brightness measurement and enhancement The Examiner also cites to 
Fowler for its disclosure of "linear mean invariant transforms (i.e., a mappings) that enhance 
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lofargram images in such a way that the each and every strip of the image is enhanced to have 
a target level of mean value" Emphasis in original* (Final Official Action,, page 6). The 
Examiner cites to Figure 1, reference numerals 3-7; column 1, lines 30-40; column 3, lines 
1 5-30; column 6, line 48 to column 7, line 5 of Fowler as allegedly disclosing the claimed 
features discussed above. 

The Examiner further asserts that "Fowler discloses enhancing all regions of an image 
such that each region has a target level for the mean value; in the case of an image containing 
faces, all facial regions and the non-facial region as a whole arc all regions of an image 
(possibly as a result of some segmentation process)," (Final Official Action, page 6)* in 
making this assertion, the Examiner has equated lofargram strips to human faces. 

The Examiner is of the further opinion that U.S. Patent No. 6,680,745 to Center* Jr. et 
al. (hereinafter "Center, Jr. ct al") and U.S. Patent No. 6,009,209 to Acker ct ah (hereinafter 
"Acker ct ah") when combined with Schildkraut et ah, Kado et al„ and Fowler, respectively 
disclose the invention as claimed in Claims 3, 4, 1 1, 12, 18, and Claims 6, 14, 20, and 25, 

B* Discussion.of the_Law 

The test for determining if a claim is rendered obvious by one or more references for 

purposes of a rejection under 35 U.S.C. § 1 03 is set forth in MPEP § 706.Q2Q): 

To establish a prima facie case of obviousness, three basic criteria 
must be met. First, there must be some suggestion or motivation, 
cither in the references themselves or in the knowledge generally 
available to one of ordinary skill in the art, to modify the reference 
or to combine reference teachings. Second, there must be a 
reasonable expectation of success. Finally, the prior art reference 
(or references when combined) must teach or suggest all the claim 
limitations. The teaching or suggestion to make the claimed 
combination and the reasonable expectation of success must both 
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be found in the prior art and not based on applicant's disclosure. In 
re Vaeck 947 F.2d 48S ? 20 USPQ2d 1438 (Fed. Cir. 1991). 

Therefore, if the above-identified criteria are not met, then the cited references foil to 

render obvious the claimed invention and, thus, the claimed invention is distinguishable over 

the cited references. 

C. The AppcllantslFosition 

The Examiner Has Clearly Misconstrued The Fowler Disclosure 

In rejecting all of the pending claims, the Examiner asserts that "Fowler discloses 
enhancing all regions of an image such that each region has a target level for the mean value; 
in the case of on image containing faces, all facial regions and the non-facial region as a 
whole are all regions of an image (possibly as a result of some segmentation process)." 
(Final Official Action, page 6). The Examiner has thus interpreted Fowler as disclosing that 
an entire image, such as ft lofargram image, is enhanced such that a particular region has a 
target level for the mean value. The Examiner has further interpreted a lofargram strip as 
being equivalent to u fecial region in an image and the lofargram as the entire image. These 
assertions arc clearly improper for at least the following reasons. 

Fowler discloses a method for enhancing lofargram data images. (Abstract). Fowler 
defines "lofargrams" as "low frequency analyzing and recording gram data*'* Column 2, lines 
9 cind 1 0. Lofargrams are typically used in submarines as visual displays of sonar images. In 
this respect, Fowler indicates that "[t]hc purpose of the present invention is to provide u gray- 
scale mapping of lofargram data enhancing it in such a way as to make signals of interest 
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more readily visible and distinguishable from background noise and to display more clearly 
the structure of the signals for better characterization/* (Column 2, lines 28-34)* 

In describing how the iofurgram data is enhanced, Fowler indicates that the lofargram 
data is segmented "into a number of vertical frequency strips covering the entire frequency 
range of a lofargram image," (Figure 2b; Column 3> lines 7*1 0)* Fowler also discloses that 
the mean and variance of the frequency for each of the vertical frequency strips 1 0 is 
determined* (Column 3, lines 46-50), Fowler further discloses that each of the vertical 
frequency strips 10 is enhanced "by applying a linear transformation to the gray scale value 
(P) of each pixel 1 1 within a vertical strip 10. The pixel is transformed to a more visible rate 
and a new gray scale value {Pnew) for the pixel is created,.." (Column 5, lines 24-33). As 
such, Fowler discloses that each of the vertical frequency strips 1 0 is separately enhanced and 
stitched back together to provide "a complete, enhanced lofargram image." (Column 3, lines 
23-30). 

Fowler apparently discloses, therefore, that the pixels of a particular vertical 
frequency strip are enhanced according to the mean and variance of the frequency for that 
particular vertical frequency strip. In other words, the mean and variance of the frequency in 
another vertical frequency strip have no effect on the pixels of the particular vertical 
frequency strip. As such, the pixels in one of the vertical frequency strips may be modified to 
have differing levels of enhancement as compared with the pixels in another of the vertical 
frequency strips. 

Accordingly, the entire lofargram image is therefore not enhanced to make one of the 
vertical frequency strips have target levels for the mean value or the variation value of the 
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pixels contained in any one of the vertical frequency strips. Instead, Fowler discloses that 
each of the vertical frequency strips is individually modified and stitched back together. 

The Examiner has therefore clearly erred in asserting that the entire lofargram image 
is enhanced such that the pixels in a particular one of the vertical frequency strips have target 
levels for the mean value or the variation value of the pixels in the particular vertical 
frequency strip. As discussed in greater detail below, this is an important distinction because 
the Examiner has equated the one or more vertical frequency strips in Fowler to the one or 
more human faces as claimed in independent Claims 1, 8, 1 5, and 21 of the present invention* 

The Proposed Combination of References Fails to Disclose the Claimed 
Invention 

Independent Claims 1 4 8 5 1 5, and 21 , recite in various forms, inter alia, that an 
appearance of an entire image is enhanced by using a mapping technique to produce the 
image with target levels for a mean value or a variation value of the pixels in one or more 
human faces located in the image, where the entire image is automatically enhanced such 
that the pixels in the one or more human faces have the target levels for the mean value or the 
variation value of the pixels. 

The Examiner relics upon Shildkraut et al. for its disclosure of an algorithm that 
automatically detects human faces in an image. In addition, the Examiner indicates that 
Shildkraut et al. fails to disclose that an appearance of the image is automatically enhanced 
by using the mapping technique claimed at least in Claims 1* S, 15, and 21 . 

In an effort to make up for this deficiency in Shildkraut et a]., the Examiner relics 
upon the disclosures contained in column 7, lines 30-52 of Kado et al and Figure 1 T reference 
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numerals 3-7, column l> lines 30-40, column 3, lines 15-30, and column 6, lines 48-column 7, 
line 5 of Fowler. More particularly, the Examiner argues that it would have been obvious to 
combine Shildkraut ct aU Kado ct aU and Fowler to somehow arrive at the claimed invention 
as set Forth tn independent Claims 1, 8, 1 5, and 21. The obviousness of the proposed 
combination is alleged upon the assertion that enhancing the image of the "feces in Shildkraut 
ct al, is an improvement over simply reducing red eye artifacts in Shildkraut ct aL 

It is respectlldly submitted, however, that the references cited by the Examiner fail ro 
at least disclose that the entire image in which the one or more human faces are located is 
enhanced by using the above-described mapping technique, such that the pixels in the one or 
more human faces have the target levels for the mean value or the variation value of the 
pixels. As such» the Examiner's proposed combination of these references fails to render the 
claimed invention obvious* 

As the Examiner has asserted, Shildkraut ct al. merely discloses techniques for 
reducing red eye artifticts in images containing human feces* (Shildkraut et a]., column 1 s 
lines 36^48). Shildkraut et al. therefore fails to disclose that the entire image in which one or 
more human faces arc located is enhanced at all, 

Kado et al. pertains to the identification of a person using facial features. The 
identification is performed by comparing an image of a person with a stored image to 
determine similarities. Kado et ah discloses, in column 7, lines 24-52, that the brightnesses 
of various patches of human faces arc corrected *1o prevent misjudgracnt due to a difference 
in the position of the light source in photographing." Kado ct al. also discloses that "the 
brightness of u patch whose normal is closer to the old direction of the light source is 
lowered, and the brightness of a patch whose normal is closer to the new direction of the light 
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source is raised*.. [so that] misjudgmcnt can be prevented under different illumination 
conditions" 

In other words, Kado ct ah discloses that the "patches" of a human face, and not the 
human face nor the entire image containing the human face, are corrected to make it appear 
that the human face is being illuminated under the same conditions as when the stored image 
was obtained. One can reasonably assume that the "patches" referred to in Kado ct al. pertain 
to dark spots, such as shadows, and ligjit spots, such as light reflections, because Kado et ah 
is only interested in attempting to make the lighting conditions of when the stored image was 
obtained and the image under consideration was obtained as uniform as possible such that the 
two images arc more readily comparable. Kado et at. therefore also fails to disclose that the 
entire image in which one or more human faces arc located is enhanced as claimed in Claims 
1, 8, 15, and 21 of the present invention. 

Accordingly, the Examiner's proposed modification of Shildkraut ct al. based upon 
the disclosure contained in Kado et al, would still fail to disclose or fairly suggest each and 
every clement claimed in independent Claims 1, 8, 15, and 21. More particularly, for 
instance, the proposed modification would at least fail to disclose that the entire image in 
Shildkraut et al. is enhanced. The Examiner's reliance upon Fowler also fails to make up for 
these deficiencies. 

As stated by the Examiner, Fowler "discloses a mapping technique specifically 
designed for lofargram images." Fowler discloses, in Figure U that the mapping technique 
includes segmenting the lofargram into strips (step 3), computing mean and variance for each 
strip (step 4), using a rule base to determine the new mean and variance for the strip (step 5), 
determining scalar and bias for the strip (step 6), and scaling and biasing each pixel in each 
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strip (step 7). Accordingly, Fowler discloses that the mean and variance for each of the strips 
are separately and individually computed and that the scalar and bias arc individually 
determined for each strip* Tn addition, once the pixels in the strips have been scaled and 
biased (step 6), the strips are stitched buck together (step S), 

In other words, therefore, Fowler docs not disclose that the entire lofargram image is 
enhanced based on any of the individual strips as discussed above* Furthermore, therefore, 
even assuming for the sake of argument that a vertical frequency strip of Fowler can 
reasonably be equated to a human face and that the entire loftrgram data can be reasonably 
be equated to the claimed entire image, Fowler would fail to disclose that the pixels in one or 
more of the human faces have target levels for the mean value or the variation value of the 
pixels as claimed in Claims 1, 8, 15, and 21 of the present invention. Instead, if the lofcrgram 
data and the image containing human faces could somehow be equated as suggested by the 
Examiner, such a comparison would result in various sections of the image containing the 
human faces to be separately enhanced, as the different vertical frequency strips arc 
separately enhanced in Fowler, 

Clearly, therefore, Fowler fails to disclose that the entire image is enhanced such that 
the pixels in the one or more human faces have the target levels for the mean value of the 
variation value of the pixels. Accordingly, the Examiner's proposed modification of 
Shildkraut et at. and Kodo ct al. based upon the disclosure contained in Fowler, would also 
fail to disclose or suggest each and every clement claimed in Claims 1, 8, 15, and 21. More 
particularly, for instance, the proposed modification would at least fail to disclose that the 
entire image in Shildkraut ct al. is enhanced such that the pixels in the one or more human 
faces have the target levels for the mean value or the variation value of the pixels. 
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Therefore, even assuming for the sake of argument that one of ordinary skill in the art 
would somehow have been motivated to combine the disclosures of Shildkmut ct ah, Kado et 
al, and Fowler as proposed by the Examiner, the proposed combination would still fail to 
disclose all of the features of the claimed invention as set forth in Claims 1 , 8 4 1 5, and 21. 
For at least this reason, the Examiner has failed to establish that Claims 1, S, 15, and 21 and 
the claims that depend therefrom are prima facie obvious in view of the Shildkmut ct aL, 
Kado et al., and Fowler disclosures. 

With regard also to independent Claims 1 5 and 21 , none of the cited references 
discloses that the target levels for u mean value or a variation value are desirable lightness 
and contrast levels that arc determined through a determination of human visual preferences. 
Instead, Shildkmut et al, is concerned with automatic face detection and red eye reduction, 
Kado ct al. is concerned with matching the brightness levels of patches in human face images 
with another human face image, and Fowler is concerned with enhancing lofargram data to 
better distinguish signals of interest from background noise. As such, for instance, none of 
these references would appear to benefit from enhancing imuges based upon the target levels 
as claimed in Claims 15 and2L 

Tfte Proposed Combination of Documents Fails to Disclose tltat the Target Levels 
for a Mean Value or a Variation Value are Desirable Lightness and Contrast Levels 
that are Determined Through a Determination of Human Visual Preferences 

The Examiner asserts that Kado et ah discloses that "pixel values dmt are to be 
enhanced to achieve target levels for a mean arc lightness values". This assertion may be 
correct; however, this assertion differs from the claimed features dmt the target levels for a 
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mean value or a variation value are desirable lightness and contrast levels that are determined 
through a determination of human visual preferences. In other words, Kado ct ah fails to at 
least disclose that the brightness correction disclosed in column 7, lines 24-52 is based upon a 
determination of human visual preferences. Instead, Kado ct aL discloses that the brightness 
correction is performed in an effort to make the face images more uniform so that 
comparisons of the face images may be made with greater accuracy. 

The Examiner also asserts that Fowler "discloses adjusting the pixel values to achieve 
a desired variance value, which results in a different contrast." Again, this assertion differs 
from the claimed feature that the target levels for a mean value or a variation value are 
desirable lightness and contrast levels that are determined through a determination of human 
visual preferences. In addition, and as discussed in greater detail below, Fowler is concerned 
with enhancing lofargram data such that the signals in the lofargrams may be better 
distinguished from background noise. As such, the enhancement performed on the lofargram 
data would not be based upon human visual preferences* 

The Examiner further asserts that the aim of the redeye reduction in Shildkraut et aL is 
to make the image more appealing, and thus "further enhancement by mapping the pixel 
values of the image to obtain desirable target levels for a mean value or a variation 
value. . .can benefit Shildkraut* s invention by further enhancing the image " Tn this passage, 
the Examiner has asserted a benefit in enhancing Shidkraut et aL, but has failed to indicate 
that Shildkraut ct aL discloses that the target levels for a mean value or a variation value are 
desirable lightness and contrast levels that are determined through a determination of human 
visual preferences. Tn fact, it is respectfully submitted that because Shildkraut et aL is only 
directed to redeye reduction in images, that Shildkraut ct aL would not rely upon human 
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visual preferences to perform the redeye reduction. Instead, the redeye reduction would 
merely be performed to remove the redeye effect from the images. 

For at least the foregoing reasons, it is respectfully submitted that the proposed 
combination of documents fails to disclose all of the features of independent Claims 1 5 and 
2i_ 

Tlie Proposed Combination of Documents £v Improper 
The Examiner asserts that the proposed combination of Shildkraut et al., Kado ct aL, 
and Fowler is proper because they are all in the field of endeavor of image enhancement 
Although these documents may be in the same broad field of image enhancement, Fowler's 
field of endeavor at least differs from that of Shildkraut et ah and Kado ct al. because Fowler 
is directed to sonar images and Shildkraut et al, and Kado et al. arc directed to fecial images. 
It seems highly unlikely for one ofordinary skill in the art of facial recognition and facial 
image enhancement to look at the art of sonar images. As such, it appears likely that the 
proposed combination of documents was based upon improper hindsight reasoni ng. 

la addition, even if one ofordinary skill in the art were somehow motivated to 
combine these documents, the proposed combination would still fail to disclose each and 
every clement claimed in Claims 1 , 8, 1 5, and 21 . For instance, the proposed combination 
would still fail to disclose or fairly suggest that an entire image is automatically enhanced to 
produce the image such that the pixels in one or more human faces have target levels for a 
mean value or a variation value of the pixels, as discussed above. 

Accordingly, it is respectfully submitted that the proposed combination of documents 
is improper and should be withdrawn. 
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The Proposed Motivation to Combine the References is Improper 

The motivation to combine the disclosures of Shildkraut ct aL, Kado et aL, and Fowler 
proffered by the Examiner is clearly improper. More particularly, the proposed motivation 
for wanting to combine these references is improper because Fowler pertains to enhancement 
of vertical frequency strips of sonar image data; whereas Shildkraut ct aL pertains to red eye 
detection and Kado ct aL pertains to the identification of a person using facial features, by 
comparing two images of the person. Thus, although Shildkraut et aL, Kado et aL, and 
Fowler are concerned with image enhancement, all three of these references arc concerned 
with completely different fields of image enhancement and one of ordinary skill in the art 
would not have been motivated to combine these references as asserted by the Examiner. 

In fact, the Examiner has provided no evidence that the proposed combination of 
Shildkraut et aL, Kado ct aL, and Fowler would result in giving "a user better control in 
enhancement process so that the resultant image can have a desired appearance or perceptual 
quality specific to the user's preference". In addition* because the disclosures contained in 
Shildkraut ct 'aL, Kado ct aL, and Fowler arc so drastically different, there is no clear 
indication as to what the proposed combination would yield. It appears extremely likely* 
however, that the proposed combination would not yield the features claimed in Claims U S, 
15, and 21 of the present invention and the claims that depend therefrom. 

Accordingly, it is respectfully submitted that the proposed combination of Shildkraut 
ct aL, Kado ct aL, and Fowler is improper and should be withdrawn. 
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C/«Jff.v 3, 4 y 11, 12, and 18 

Claims 3, 4, 1 1,1 2, and 1 8 have been rejected under 35 U.S.C §1 03(a) as allegedly 
being unpatentable over the disclosure contained in Shildkraut et ah in view of Kado ct al- 
and Fowler, and further in view of Center, Jr. ct al. This rejection is respectfully traversed 
because Shildkraut ct al. considered singly or in combination with Kado et al., Fowler, and 
Center, Jr. ct al. fails to disclose all of the elements of independent Claims 1, S, and 15 and 
the claims that depend therefrom. 

The Examiner asserts that Center, Jr. ct al. discloses that contrast and/or color is 
changed to enhance an appearance of an image. The Examiner does not however, assert that 
Center, Jr. ct al. discloses automatically enhancing an appearance of an image by using a 
mapping technique to produce the image with target levels for a mean value or a variation 
value of the pixels in the human faces, as claimed in independent Claims 1 , S, 15, and 21. 
The Examiner also cannot reasonably assert that Center, Jr* et al. discloses these features. As 
such, Center, Jr. et al. docs not make up for the deficiencies in Shildkraut ct ah, Kudo et al M 
and Fowler as described above. The proposed combination of Shildkraut ct ah, Kado ct al. 
Fowler, and Center, Jr. et al., therefore, fails to disclose all of the features of independent 
Claims 1 , S, and 1 5 and the claims that depend thcrcfrom. 

Accordingly, the Examiner is respectfully requested to withdraw the rejection of 
Claims 3, 4, 1 1, 12, and 18 and to allow these claims. 

Claims 6, 14, 20> and 25 
The Official Action sets forth a rejection of Claims 6. 14, 20, and 25 under 35 U.S.C. 
§1 03(a) as allegedly being unpatentable over the disclosure contained in Shildkraut ct al. in 
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view of Kado ct a], and Fowler, and further in view of Acker ct al. This rejection is 
respectfully traversed because Shildkraut ct al. considered singly or in combination with 
Kado ct aL, Fowler, and Acker ct ah fails to disclose oil of the elements of independent 
Claims 1 , 8, 1 5 and 21 and the claims that depend therefrom. 

The Examiner asserts that Acker ct al, discloses "reducing or removing the red eye 
artifact from the human faces." The Examiner does not however, assert that Acker ct al. 
discloses automatically enhancing an appearance of an image by using a mapping technique 
Lo produce the image with target levels for a mean value or a variation value of the pixels in 
the human faces* as claimed in independent Claims 1 , S» 15, and 21 . The Examiner also 
cannot reasonably assert that Center, Jr. ct aL discloses these features. As such, Center, Jr. ct 
al. does not make up for the deficiencies in Shildkraut ct al,, Kado ct al., and Fowler as 
described above. As such, Acker ct al. does not make up for the deficiencies in Shildkraut ct 
al., Kado ct al., and Fowler as described above. The proposed combination of Shildkraut ct 
aI M Kudo et al. Fowler, and Acker et ah, therefore, fails to disclose all of the features of 
independent Claims 1,8, 15, and 21 and the claims that depend therefrom. 

Accordingly, the Examiner is respectfully requested to withdraw the rejection of 
Claims 6, 14, 20, and 25 and to allow these claims. 
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(8) Conclusion 

For at least the reasons given above, the rejections of claims 1-3, 4, 6, 8-1 2, 14, 1 5, 1 8, 
20, 21, 25, and 27-33 arc improper. Accordingly, it is respectfully requested that such 
rejections by the examiner be reversed and these claims be allowed. Attached below for the 
Board's convenience is an Appendix of Claims 1-3, 4, 6, 8-12, 14, 1 5, 1 8, 20, 21 , 25, and 27- 
33 as currently pending. 

Please grant any required extensions of time and charge any fees due in connection 
with this Appeal Brief to deposit account no. 08-2025. 



Respectfully submitted, 



Dated: February 19, 2007 




Timothy B. Kang 
Registration No.: 46,423 



MANNAVA & KANG, P.C- 
8221 Old Courthouse Road 
Suite 104 



Vienna, VA 22182 
(703) 652-3817 
(703)865-5150 (facsimile) 
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(9) Claim Appendix 

1. An image enhancement method using face detection algorithms, comprising: 

automatically detecting one or more human faces in an image using face detection 
algorithms; 

automatically locating the one or more human faces in the image; and 
automatically enhancing an appearance of the entire image by using a mapping 
technique to produce the image with target levels for a mean value or a variation value of the 
pixels in the one or more human faces* wherein the entire image is automatically enhanced 
such that the pixels in the one or more human faces have the target levels for the mean value 
or the variation value of the pixels* 

2. The method of claim 1, wherein the enhancing step includes automatically enhancing 
lightness levels of the image to enhance the appearance of the one or more human feces. 

3. The method of claim 1, wherein the enhancing step includes automatically enhancing 
contrast levels of the image to enhance the appearance of the one or more human faces. 

4. The method of claim 1 , wherein the enhancing step includes automatically enhancing 
color levels of the image to enhance the appearance of the one or more human faces. 

6. The method of claim 27, wherein the enhancing step comprises: 

reducing or removing the red eye artifact from the one or more human faces. 
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8. An apparatus for enhancing an image using face detection algorithms, comprising: 

a module for automatically detecting human faces in an image using face detection 
algorithms; 

a module for automatically locating one or more human faces in the image; and 
a module for automatically enhancing an appearance of the entire image by using a 
mapping technique to produce the image with target levels for a mean value or a variation 
value of the pixels in the one or more human faces, wherein the entire image is automatically 
enhanced such that the pixels in the one or more human feces have the target levels for the 
mean value or the variation value of the pixels. 

9* The apparatus of claim 8, wherein the image is a digital image 

1 0. The apparatus of claim 8, wherein the module for enhancing the appearances of the 
image includes a module for automatically enhancing lightness levels of the image to 
enhance the appearance of the one or more human faces, 

1 1 . The apparatus of claim 8, wherein the module for enhancing the appearances of the 
image includes a module for automatically enhancing contrast levels of the image to enhance 
the appearance of the one or more human faces. 

1 2. The apparatus of claim 8, wherein the module for en hancing the appearances of the 
image includes a module for automatically enhancing color levels of the image to enhance the 
appearance of the one or more human faces. 
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1 4» 'flic apparatus of claim 2S, wherein the module for enhancing the appearances of the 
image comprises: 

a module for reducing or removing the red eye artifact from the one or more human 

faces* 

1 5. A computer readable medium comprising instructions for image enhancement using face 
detection, the instructions comprising: 

automatically detecting one or more human faces in an image using fiice detection 
algorithms; 

automatically locating the one or more human feces in the image; and 
automatically enhancing an appearance of the entire imagery using a mapping 
technique to produce the image with target levels for a mean value or a variation value of the 
pixels in the one or more human faces, wherein the target levels arc desirable lightness and 
contrast levels as determined through a determination of human visual preferences, wherein 
the entire image is automatically enhanced such that the pixels in the one or more human 
faces have the target levels for the mean value or the variation value of the pixels. 

1 8. The computer readable medium of claim 15, wherein the instructions for enhancing the 
appearance of the image includes automatically enhancing color levels of the image to 
enhance the appearance of the one or more human faces to a target level as determined 
through a determination of human visual preferences. 
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20. The computer readable medium of claim 29, wherein the instructions for enhancing the 
appearance of the image comprises: 

reducing or removing the red eye artifact of the human faces. 

21. A system For enhancing an image using face detection algorithms, said system 
comprising: 

means for automatically detecting human faces in an image using face detection 
algorithms; 

means for automatically locating the human faces in the image; and 
means for automatically enhancing an appearance of the entire image by using a 
mapping technique to produce the image with target levels for a mean value or a variation 
value of the pixels in the human faces, wherein the target levels are desirable lightness and 
contrast levels as determined through a determination of human visual preferences, wherein 
the entire image is automatically enhanced such that the pixels in the one or more human 
feces have the target levels for the mean value or the variation value of the pixels. 

25. The system of claim 21, wherein the means for enhancing includes means for 
automatically locating eyes in the human faces and means for reducing or removing the red 
eye artifact from the human faces. 

27. The method of claim 1 , wherein the locating step includes automatically locating eyes in 
the human faces. 
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28- The apparatus of claim S, wherein the module for locating the human faces includes a 
module for automatically locating eyes in the human feces. 

29. The computer readable medium of claim 1 5, wherein the instructions for locating the 
human feces include automatically locating eyes in the human faces. 

30. The method of claim 1, wherein the enhancing step further comprises enhancing the 
image by one of adding and subtracting a fixed amount to a lightness component of each 
pixel in the human feces, wherein the fixed amount is selected to produce an output image 
with atarget mean lightness level of the pixels (x) in the face region, and wherein the output 
image O) is determined through the following equation, 

y-x * T , where T = m r -m x , wherein m x is the mean of x and 7*is a transformation 
that substantially ensures that the m x is equivalent to an output image m t + 

3 1 . The method of claim 1 » wherein the enhancing step further comprises enhancing the 
image by substantially ensuring that an output image (y) has a target standard deviation tr h 
wherein the output image (y) is determined through the following equation* 



image, m x is the mean of x, rr x is the standard deviation of the face pixels x y and Tis a 
transformation that substantially ensures that the standard deviation <r x is equivalent to the 
target standard deviation <7>. 




, wherein x represents the face pixels in the 
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32. The method of claim 1, wherein the target levels are desirable lightness and contrast 
levels as determined through a determination of human visual preferences. 

33. The apparatus of claim 8, wherein the target levels ore desirable lightness and contrast 
levels as determined th rough a determination of human visual preferences. 
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(10) Evidence Appendix 
None. 
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(11) Related Proceedings Appendix 

Hone 
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